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ABSTRACT 

This paper describes a collaborative project that 
sought to combine teacher development and illuminative research. 
Eight teachers on a general English course, working in pairs, 
observed each other's lessons and then held discussions, which were 
recorded and analyzed both quantitatively and qualitatively. 
Published coding systems were used by the teachers during the 
observation of their colleague's lesson, while a two-dimensional 
coding system (covering topics and speech acts) was developed for the 
quantitative analysis of the post-lesson discussions. Teachers 
reported that the opportunity to observe their colleagues was very 
valuable, and that the published coding systems were useful, though 
at times constraining. The coding system designed to analyze the 
discussions, though found to be unreliable on the speech act 
dimension, proved helpful in illuminating patterns of interaction. 
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PEER OBSERVATION AND POST-LESSON DISCUSSION 
Sheena Davies and Brian Parkinson (IALS) 



Abstract 

This paper describes a collaborative project which sought to 
combine teacher development and illuminative research. Eight 
teachers, on a General English course, working in pairs, observed 
each other's lessons (one lesson per teacher) and then held 
discussions, which were recorded and analysed both qualitatively 
and quantitatively. Coding systems were used at two stages: by the 
teachers during the observation (published systems), and by the 
researchers, who devised a two-dimensional system (t.ptcs and 
speech acts') for the quantitative part of the analysis of discussions. 
Teachers reported that the opportunity to obsene was very valuable, 
and that the published coding systems were useful though at times 
constraining. Our discussion analysis system, although unreliable 
on the 'speech-act' dimension, proved helpful in illuminating 
patterns of interaction. 



I. Background 

1 . 1 Types of observation and ways of doing observation 

The observation of FL lessons has a long history, but only in the last 10-20 years 
has it "come of age", with a proliferation of observation systems, articles and 
textbooks. 

We can distinguish four main types of observation, according to observer identity and 
purpose; - 

(i) by "experts', as part of teacher "training" and teacher evaluation. This type 
occurs frequently in pre-service programmes, and is also done by inspectors, 
head teachers etc. 

(ii) by researchers, as part of an attempt to describe and understand classroom 
events. This may be as part of "pure" research (e.g. Mitchell et al. 1981) or 
curriculum evaluation (e.g. Parkinson et al 1981). 

(rii) by trainees, observing experienced teachers or each other, presumably in order 

to learn, crudely speaking, how and how not to leach, 
(iv) by practising teachers, observing each other or peers - see Section 1 2. 

We can also distinguish three main ways of doing observation, although these 
distinctions are not clear-cut:* 
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(a) Unstructured: the observer simply makes a note on what he/she considers salient 
- sometimes no more than a global impression of the lesson. This type has often 
been associated > ■. (i) above, and is also very common in (iii). It may indicate 
lack of thought about observation, or reliance on unarticulatcd professional 
experience. The rare cases of genuine ethnographic observation can also be 
included here, though very different in other ways. 

(b) Semi-structured/high inference: the observer has a list of questions to answer 
about the lesson, and sometimes also boxes to fill in, but these tend to require 
global decisions and exercise of considerable judgement. This way of doing 
observation is sometimes criticized for unclear criteria and low reliability, but 
may be justified when observers (and users of the information) have similar 
expertise and values. 

This way ot doing observation has been used lor all of types (i) to (iv) above. As an 
example, we give an extract from a checklist 'or Practical Tests former]) used in the 
Diploma for Overseas Teachers ot Hnglish run by the Royal Society of Arts, 
reproduced in Malamah- Thomas (1987): 



PI RSONA1. QUAI lllt ; S 


GRADI 


x'OMMl-NIS 


I'cfMHiaht) - Presence' general M\k' 






Ahiln> 10 establish rapport 






Voice Audibiliiv ahtltt} to profit 







PREPARATION 


(pRADIi 


COM Ml M S 


I i'\mui plan, balaikc and \arien 






<*lant>. limitation and ^pccilicjtuui ol aim 






Suiuhilii) ot male riah and ipcthudx t«'i liru'l 
and t\fH' of cla^v 







(c) Slructured/low-infcrence. the observer's record ot the lesson is compiled 
according to a detailed rubric or "coding system' with a pre set list of categories 
and guidelines on how often to make a coding. Usually but not always, the 
category requires less inference and judgement than in (b) above. Examples of 
coding systems arc given later in the paper. 

This way of doing observation has been common in type (iii). especially the 
MAC (Flanders 1960) and Hint (Moskowit/. 1971) systems, and e\en more so 
for type (ii) (examples later - see Chaudron 1988 for a review.) 

1.2 Peer Observation 

From our experience, informal contacts and reading it seems thai in most or all kinds 
of teaching (countries, subjects, class types etc.). peer observation is much less 
common than observation b> someone m 'authority' above| or in training [(iii) 
above) Many writers on teaching mention peer observation in passing as a sound 
idea, but in practice time is short and other priorities, and perhaps cmbairassment. 
interfere ^specially rare is peer observation which is systematic in any sense - cither 



in that it uses a coding system, or even in that there are definite schedules and 
objectives. 

An important exception is the work cf Fanselow, who has stressed the value of peer 
observation for helping teachers in 'generating and exploring alternatives', and has 
advocated his own FOCUS system for this (Fanselow 1977). In our experience 
teachers exposed to Fanselow 's work are impressed by his general perspective, non- 
dogmatic and exploratory, but the FOCUS system itself is found complicated and 
daunting, and other systems, originally designed for research purposes, are preferred. 
It seems that the FOCUS system has had fairly extensive use ir. the author's own 
circles, and perhaps elsewhere in the USA, but the extent of its wider use and 
usefulness is unclear. 

There have, however, been several recent articles stressing the value of peer 
observation, e.g. Richards and Lockhart (1990), Lockhart (1991), and teacher 
development through peer discussion e.g. Edge (1992) and Underhill (1992). These 
are useful in that they provide different perspectives on the topic but only Richards 
and Lockhart discuss empirical work and there is no detailed description of their 
findings. Similarly, though the first two articles both mention lesson coding systems - 
Lockhart says that after deciding what to look for teachers "can either create or 
choose an instrument which best codes this behaviour" - details of systems and their 
operation are absent. 

The article by Edge describes a framework for peer discussion; this framework, 
containing line categories (adapted from Egan) * Attending, Reflecting, Focusing, 
Themat^in Challenging, Disclosing, Goal-setting, Trailing, Planning - describes 
and defines the style of interaction and is part of a particular approach which Edge 
calls "Co-operative Development". Though it was designed for a differently 
constrained peer discussion, we found it an original and useful, if indirect, input to 
our work. 

2. The Context Of Our Research 

The research took place in 1992 on General English classes at the Institute for 
Applied Language Studies. The General English course is a full time course of 20 
hours per week and the students are, in the main, \oung adults of various nationalities 
who come for a full term of 1 1 weeks. The majority study English to improve 
employment opportunities, a minority to prepare for post-graduate qualifications. 
(Masses at different times of the day focus on the development of different skills. 

The teachers are all well-qualiFed professionals, and all had had previous experience 
of being observed and observing others. Three had briefly encountered coding 
systems some years earlier on a master's course in applied linguistics; beyond this, 
however, none had ever used particular coding systems and no structured system of 
peer observation has, :o date, been set up at IALS. 
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3.1 Objectives 

These were stated as follows in the research proposal: 

1 To provide teachers with an opportunity to learn by observing other teachers- 
lessons, receiving comments on their own and discussing issues ans.ngu 
supported if required by classroom observation l.terature (e.g. Allwnghi & 
Bailey 1991). 

2. To inform the academic communis on the outcome of this process (research 
paper) with particular attention lo: 

the terms in which teachers conceptualise iheir own and others' lessons 
what is perceived as different 
(iii i what is perceived as surprising 
( u » what attracts positive, negative and neuir.n comment 

»v> what use. if any. is made of classroom observation mstrument, o. other help 

<vil rifwavs. if at all. teachers would like to continue the peer education and 
self-education process 

3.2 tleneral Procedure 

Eittht teachers - all those working on the GK course at the linK - were invited to 
p r t ipa n the project, on a voluntary basis, and all agreed. They were put into 
Z pairs nd each member of the pair observed one lesson by the other member lor 
U as one hour (lessons las. 90 or 100 minutes. The teachers then had a post-lesson 
d cu ion in two parts, one for each lesson, each par, to las, approximately 30 
m nute The researchers were no, present a. either lessons or dtscuss.on. except in 
oT e wtere a researcher ,SD1 was one of the teachers. The lessons were no. 
horded but the discussions were, and the research was conducted on .he 
undemanding that discussions, no, lessons, were ,he mam focus o ; 
was a'so pressed ,ha, ,he research was non-evaluative in a double sense observers 
Th u d m udge- .he lessons, and researchers would no, judge the dtscuss.on 
ZZtLZ -be purpose was mainly one of professional development exploring 
whatever issues were of interest. 

lanes Of the discussions were transcribed (by research assistants who were 
experienced EFL teachers), and these transcripts (checked w,,h the urinal where 
necessao ) constitute the main par, o, our da.a They are supplcmen.ed b> ,wo minor 
data sources: 

(„ ,he completed coding sheets (see Section 4 1 below, used by the observers and 
(u) a post-discu,sion questionnaire (see Section 4 2 below i. 

The teacher/observers were given a selection of recognised coding systems, with 
, ack grouml ^formation (see Section 3 3,. and asked to select one o. these before 
2 S and use it during observation. In addition, they were asked to make notes 
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of anything observed which was not covered by the system but which seemed" 
surprising interesting, etc. (cf. research questions, of which observers had a copy) 
To facilitate this observers were provided with a three-page coding sheet with space 
for bom system-based comments and open-ended comments. 

The observers were not expected to use the systems 'properly', i.e t0 make 
exhaustive coding using exact definitions. This would have been impossible without 

£EZ r n ' ng ' ^ ^ WCre aSked 10 USe !hem as a basis for entries which 
d cated the mam patterns of the lesson. It was stressed, however, that something 

r^dt atfem^ ' mPreSS '° n ^ tha ' SeqUemia '' timed ^ 

In the post-lesson discussion the teacher/observers were asked to discuss the lesson, 
m whatever way they felt useful. This could be. but did not have to be. based part y 
on the coding sheets. p J 

3.3 Coding Systems Offered and Used 

The following is a brief summary of the systems offered for observer use: 

<» 'BIAS' system (Crown 1975). Indicates whether teachers or learners are 
speaking, and whether they are lecturing, questioning, respondinu etc 

CD Bowers' system (Bowers 1980). Looks at social functions of'classroom 
language - presenting, directing, organising, eliciting, evaluating responding 
sociating. r & ' 

(■■■) 'COLT' system (Lrohlich et al 1985) A high-inference system judging presence 

of communicative features in interaction, 
(iv) Allwright s error treatment system (Allwright 1988). How teacher treats errors 
iv ) Chaudron's system (Chaudron 1977). As (iv) but more complex 
(v.) hmbryonic system (Long et al. 1976). A lis. of 17 'pedagogical moves' e g 

initiates discussion, summarizes, provides example. 13 'social skills' eg 

interrupts, contradicts, encourages, jokes; 14 'rhetorical acts', e.g predicts' 

hypothesizes, deduces, negates, 
(wi) Pica and Doughty system (1985). Lor the analysis of group- work, and how 

students check mutual understanding, 
(viii) Allwright s turn-taking system (1980) . Taking turn* stealing' turns, offerins 

the floor in other learners and so on. 

Only the first three of these systems were actually used. 
3.4 Data Analysis 

This focusscd almost entirely on the discussion (other minor sources . coding sheets 
and questionnaires - are briefly discussed in the results section). Analysis was mainly 
Irom the transcripts, but the original tapes were listened to where necessary. 

lo analyse the transcripts, we devised a two-dimensional coding system coverine (i) 
the types of topics discussed and (ii) the » ■ s in which teachers interacted and what 
we perceived as the underlying speech acts. Our categories were largely post-hoc' 
i.e created to cover what we found in the transcripts, but we attempted to keep in 
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mind our research questions and make only those distinctions necessary to answer 
these . 



The system was devised jointly by both researchers, and several joint codings were 
attempted in order first to improve and then to measure inter-coder reliability. Due to 
the small amount of data, a rigorous reliability study was not possible but, after 
coding, a final inter-coder reliability check was made and the results are reported in 
Section 4.3.1 below. 

The categories used, with examples, were as follows:- 



A. Topics 



Number 


Topic 


Kvimplc 


I 


Facts aboul siudenls e.g. nationalih . 
level, age. 'history 


"He's been here lor ages and he's going to be here tor even 
further ages"' 


2 


Observation system used b\ coder 


" Thai's the. cm the one thai is supposed to measure the social 
(unctions ol the language that goes on 


3 


f-xpectations 


"Had wui got any preconceived ideas aboul whal would Ik* 
happening'" 


4 


Relation between expectations and 
events 


"No wcl' I suppose I imagined probablv aboul what 1 saw, 1 mean 

_ . . ~ „ a n< i r/\nw« urifi n*o niil <nnn* ri**il i'(ininiiinii*nti(Hi 
sonic inpui nnu sumil piuvikl «uu ^muiv ii«u LMnuiiuuKiHiun 


5 


The observed lesson (general) 


"So that's vvhv thev had this son ot check list they were using. 


5.1 


The observed lesson (ler.rncr 
behaviour) 


"He w;is making a face 1 . I he wasn'i seeking confirmation ' 
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The observed lesson (teacher 
behaviour) 


"And at one point you sort ot bio*e otl cvei vilung and said i on 
1iH)k pu/./ted" "- 


6 


Other lessons by same teacher 
(general) 


We had been doing nunc a loi ol work beforehand on discission 
techniques". 


6.1 


Othrr lessons by same teacher (learner 
beha -iouD 


"He doesn't often do that actualh" 


6.2 


Other lessons by same teacher (teacher 
behaviour) 


"In that kind ot situation 1 don i. er, it thev ask me a question 1 
lust turn awav". 


7 


Oih^r iftcnnc hv nh^rrver fccncral) 


Similar (o 5 and (> 


7.1 


Other lessons b" observer (learner 
behaviour) 


Similar to *> 1 and 6 2 


7.2 


Other lessons by observer t teacher 
behaviour) 


Similar to s 2 and 6 2 


8 


Other lessons or lessons in general 
(general) 


Similar to 5 and ft 


8.1 


Other lessons or lessons in general 
(learner bchanour) 


Similar to 5 1 and (> 1 


8.2 


Other lessons or lessons in general 
(teacher behaviour) 


Similar to * 2 and 6 2 


9 


Linguistic theories/concepts 


"It's amazing how much, well er. 1 won t sa> students . 1 mean 
am one can. how much you can read without actually taking am 

oi u m." 


10 


Materials and syllabus 


"Was thai something lhat came up m the textbook'.'" 


11 1 


Personal feelings (general) 


"1 was genuinely surprised" 


11.2 


heelings about being observed 


when vou've son of cr being waiilied l>v vour peers as u 
were, \ou do feel a certain, lhat you sue Iwmg nidged [. 1 it is a 
bil nerve racking..." 


11 1 


Feelings aboul discussing lesson 


"I don't want to sorl of make ;mv evaluative comments or 
judgments on the thing" 


12 


the F.nglish language 


"But 1 mean what is the actual diclionaiv definition of 
'authoritative' '* 
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H I 


The project in general 


Well it seems to me lha; to get the most value from anything like 
this, viewing each other once is just nothing like enough." 


m : 


Observation in general 


1 wonder how far what one learns from observing is actually 
useful when you're actually teaching. Maybe it is in the planning 
stage." 


14 


Other 


VVhat did you say? 


B. Inten 


action patterns/underlying "speech acts" 


Label 


"Speech Acts" 


Kxamples 


BC 


Back-channelling 


Ah. I see. Right, right." 


SV 


Sympathising 


This is a big problem isn't it. thai everybody has." 


SP 


Speculating 


Maybe she only talked a lot the second time because she was 
Iplaying another rolcj." 


UN 


Question (neutral) 


Was it difficult to try to use it?" 


QC 


Question (challenge > 


Bui why did me t.ing there stop you doing it spontaneously!?" 


[Sl- 


informing 


"After you left they staned discussing again." 


OP 


Opinionaiing 


"I think X is very much a sort of actor anyway." 


\.\ «■ 


Evaluation (positive) 


"It was good that it was slipping into real discussion." 


l-V 


Evaluation (negative) 


u) "(My) board work was pretty awful" 

(m) "The only thing was. the only thing was, that it was, they, 
the particular constructions with the particular prompts did 
seem to be causing some rather odd constructions..," 


Ih 


Inviting evaluation 


Was there anything else that surprised you. that you wanted to 
ask me why you did something? 'Cos it's very- useful for me as 
well to get sort of, a reaction of some kind." 


A 


Adverting or scmi-phatic 


"You reminded them about erm what thc> had done the previous 
week." 


J 


Justiking 


1 mean the point of that exercise was to see whether they had 
actually got their heads round the, cm, the distinction." 


SG 


Suggesting 


"If they'd had a piece of paper with it written down it probably 
would have been easier." 


\(i 


Agreeing 


"Yes. Anna said that a couple of t:nics, ves." 


Other 


Other 


"Oh. maybe " 


N.B. These speech acts" must be interpreted in their interaction with different topic 
categories, and with who (teacher or observer) is speaking. For example, 
commonsense suggests that evaluating one's own lesson, one's interlocutor's 
lesson and a third party's lesson are three very different kinds of speech acts, 
lhe grand total lor each "speech act" may thus sometimes be less illuminating 
than totals for individual combinations of topic and "speech act". 

4. Results 

4.1 Information from Lesson Coding Sheets 



Six of the eight teachers handed in their coding sheets (They were mil obliged to do 
>o since the focus was on the post-lesson discussion.) 

When analysing the data, we asked ourselves the following questions: 

♦ how long did they keep on coding? 

♦ did they use their own categories nr those of the 'system ? 

♦ what was the balance between the 'system' observations and the open-ended 
observations? 

♦ whai type of comment/information was in the open-ended column? 
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♦ did they use the third checksheel (for general comments)? 



All the teachers coded the lesson events for the full hour, following the time 
segments. The use of the categories of their chosen systems varied from full use of 
all the categories (by two teachers using the BIAS system and one using BOWERS) to 
partial use of the categories (by two using COLT and one BIAS). Most teachers gave 
some illustrations or explanations of these categories in the system column. For 
example: "Sociating - rearranging bodies" (BOWERS); "S /= Silence/ because 
focussing their minds & individually formulating ouestions" (BIAS). 

In the open-ended column, most comments were descriptions of lesson events - a 
combination of more illustrations of the system categories and descriptions of other 
events focussing on teacher or student behaviour, or examples of language used, such 
as; "Qs on OUT on topics of film"; "E. demonstrate swagger by walking" One sheet 
also included several positive evaluative comments: "most Ss participating well": T 
good at involving any S who is reticent (left out " 

The balance of observations between the two columns seemed fairly even, and in most 
cases there was nothing substantially different between the two. apart from one coding 
sheet in which the open-ended column consoled mainly of diagrams of the teacher- 
student interaction. This reflected the personal interest of the teacher concerned, an 
interest she elaborated on in both the post-lesson discussion and the general 
checksheet 3. 

Chccksheel 3 gave observers the opportunity to make any further comments and was 
submitted by only four teachers. They each used Sheet 3 for further descriptions of 
lesson events, but two also made comments and posed questions about the system and 
what they were trying to do. For example, "Is communication genuine if T clarifies 
language for S?"; "Difficult to concentrate on different levels of communication e.g. 
interpersonal, formal, penary"; "Prediction of a lesson format v. difficult if not 
impossible" These issues were later raised in the post-lesson discussion between the 
teacher and the observer. 

4.2 Information from Questionnaires 

Tutors were asked to fill in a questionnaire to supplement the data Irom the 
discussion. The questions were open ended (see below) and anonymity was 
guaranteed . 

1 \Yh> did you choose ihc ohscrsalion sssicni(s) sou did 1 Was it 'were thes a help or 3 
hindrance 0 

2 What, if am thing, did sou find useful or \ ,iliiahlc about 
ia> observing another's class * 

(h) being observed? 

id discussing the lessons' 
i Did sou feel ans constraints in the poM obveisaiion ibnuvsion 1 
4 How, if at all. would you like to follow ihiv up* 



The responses, though varied, show some measure of agreement Not surprising!) 
perhaps, four out of the eight tutors slated that they had chosen the system because it 
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reflected an area of interest, while the others selected a system for its apparent 
manageability for real-time coding and its "^gree of teacher-friendliness". 
7 chose a system that seemed best suited to look at teacher-student interaction" 
(BOWERS); "It seemed reasonable to handle within the constraints of timing and is 
an area of personal interest. " (BIAS) 

With regard to its usefulness, there were only two unqualified answers - one found it 
useless, the other a positive help by providing a systematic framework. The 
remaining tutors found it of limited usefulness - a help initially by giving a guideline 
or focus but then becoming a hindrance because it was too restricting or difficult to 
use. or inappropriate for the actual classroom events. "A good guideline, but perhaps 
too narrow . "; "On the whole it was a help but sometimes it was difficult to observe 
other useful and interesting events because of the focus of the obsenution system. " 

All the tutors, however, were positive about observing another's class and there was 
strong agreement in the reasons given, such as: "interesting and informative to watch 
how someone else deals with a topic "makes you review your own teaching 
methods"; "it is always useful to pick up new ideas from other teachers" 

The comments cm being ohserved echoed the comments above, for example: "having 
(mother person's opinion about a problem"; "makes you think a little more about 
what you do and say, and how much you say" and also included the opinion that "As I 
believe in team teaching as a useful method of teaching certain types of classes and 
students, I think it is helpful to be obsen-ed and to be able to feel comfortable and not 
m any way inhibited by the presence of ath 'her teacher. " 

Similarly, the post-lesson discussion attracted positive comment - again, mainly 
echoing the points made above but two teachers made similar observations about 
interpretation and perceptions: "interesting to see whether what the teacher felt had 
been important. 'salient corresponded to what the obsener felt "; "I found it inte. ssting, 
and quite surprising sometimes, how an obsener interpreted what I did" 

Only one person found the experience of being ohserved and the post-observation 
discussion nerve wracking; nor did this teacher like i. . discussion immediately after 
the lesson, preferring (in retrospect) to have had more time to reflect and be more 
analytical. 

There was a high level of unanimity among the responses to the questions on feelings 
of constraint in the post-observation discussion. Five tutors commented that they 
would not want to say, or tried to avoid saying, anything critical about their 
colleague's lesson because it was a peer situation. This does not mean that they felt 
there had been something negative to say, only that they would not have wanted to 
say it if there had: "If I really didn't like something I saw or had a negative criticism 
(which was not the case in the one obsenation) I feel that this set up would not 
encourage me to say anything. ": "I wouldn't want to say anything negative (even if I 
had something to say) as it was a peer situation and as such should be supportive and 
non-judgemental. " 

This conforms with the emphasis on the non-evaluative nature of the research project 
in general and the lesson observation in particular (see 3.2 above) but it is interesting 
that such a feeling should be perceived as a constraint. Only one person implied that 
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there were negative points made about the observed lesson. Other constraints 
mentioned were the artificiality of talking into the microphone (initially), and talking 
in a more 'formal' way rather than a chat over a cup of coffee. 

With regard to possible follow-up. the points made tended to fall into two main 
categories: 

(a) introduce a system of frequent observation as routine teacher development, not 
as a research project (five teachers mentioned this) 

(b) if the project is repeated, to have a more focussed system on topics agreed on by 
participating teachers (two teachers) 

4.3 Introduction to Discussion Coding Tables 

The following tables gi%e the overall coding totals for observers and lor teachers. 
Thev show the number of occurrences in each ca.egory. and each combination of 
"topic* and speech act category 



Table 1 

Observer Moves - Grand Total 



1 Facts aboul students 



Coding svsiem 



Expectations 



Relation 
expect event 



BC SV 



Observed lesson 
(general ) 



Observed les* n 
tSSl 



5.2 Observed lesson <T> 



6 T*s lesson t gene rail 



SP ON 



I 15 



6.1 T s lesson (SS i 



T's Icssimi (T> 



7 O's lesson i general) 



7.1 



O's lesson tSS) 



7.2 O's lesson ( T) 



8 Other lessons (gen \ 



3 1 



QC INP 
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43,1. Inter-coder reliability 



As an inter -coder reliability check, half of one discussion, chosen ai random, was 
coded oy both researchers. We chose not to give a single percentage figure or set of 
figures for reliability, considering this to be meaningless as it could be calculated in 
many different ways. The statistics seem to show, however, that our 'topic" figures 
have some inter-subjective status: agreement is as high as could be expected in a 
small, exploratory study. The "speech act" agreement, on the other hand, is 
disappointingly low, and means that our figures on this dimension must be treated 
sceptically, though they can give some general indication of how teachers behaved. 

As far as we can tell, our difficulties were not mainly to do with conceptualising the 
categories, we seemed to agree on what we meant by informing, evaluating etc. - but 
Dii interpreting specific utterances, illoculionary force is often not totally explicit, and 
K is uell known that it may be difficult for third parties, and cum for participants, to 
recognise it uiih ccriainh . 

4.4 Annotated selection of tencher comments 

This section aims to supplement the quantitative information on the discussion with a 
selection of teacher comments, organised by topic, which seem particularly relevant 
to the research questions. We have omitted hesitation devices and repetitions as far as 
possible, except where they seemed important to an understanding of the interaction, 
but wc have not achieved total consistent in this, nor in our indication ot minor 
abridgement. Comments by both observer jo| and the teacher HI being observed are 
included. 

4.4.1 Comments on use and usefulness of coding system 

As already indicated, we asked teachers to he guided b> the s\Mem rather than to 
attempt exhaustive coding of every utterance, and most did exactly thai Nonetheless, 
several offered reasons (in the discussions) for their limited use ot their chosen 
s>stem, often coupled with comments on its adequacy or otherwise 

7 uym tnmg to use ... Brown's Interaction Analysts (BIAS) When I looked 
through the ones on offer, it seemed to be quite interesting. It was m the area that I 
wanted to consider. But .. it's very diffu ult to actually stick to one of these systems 
exactly, because there aren 't enough categories. Or these categories given here are 
not exactly relevant to the type of lesson you were doing. I would have liktt to 
include mo/<? eategories because some of these ... sound negative eg. teacher 
lectures'. 7? me that has a negative overtone that the teacher's jawing away all the 
time Then it says "explains " and "directs " well \es. you did that a few times, on the 
sheet I've put down "77/" in various situations, but it was vers- short, succinct and 
straight to be point ." \0\ 

We would not presume to reduce such comments to a one-sentence summary, but the 
main points are perhaps (i) the "ethnographic" one that pre set sy.tems tail to capture 
the richness of experience, (li) mismatch between system and modern methods and 
(iii) distrust of evaluative labels. 
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4,4,2 Comments on effect of observation 



As usual in studies of this type, the question arose of the effect, if any, of observer 
presence on teacher behaviour and learner behaviour. Effects on the teacher were 
only rarely mentioned: "I'm always a bit nenvus though, I think you tend to be, no 
matter what you say you still think you 're being watched and evaluated. " A possible 
effect on learners was mentioned slightly more often: "They're usually quite a lively 
class specially first thing in the morning ...so it might have been the fact that \ou 
were here that might have had an influence" The majority view, however, seemed to 
be that the effect of observation was small, e.g. "No, I don't think the\ were affected. 
X has been in to watch them for a lesson, and people pop in and out, and I film them 
.. so I don't think they're bothered too much by other people" 

4.4.3 What attracts positive comments 

Although all observers showed a positive and supportive attitude towards the teacher 
and the observed lesson, they did not find it necessary to make frequent comments of 
direct praise. Interestingly, many evaluative comments related to students rather than 
the teacher, although some of these might be interpreted as indirect praise of the 
teacher: "Tfiey seemed to be working very naturally together"; "They really did seem 
to get on well together, that was nice. I mean there was quite a lot of er, 1 was quite 
surprised, there was quite a lot of touching actually between them ... you know, 
playful slaps on the and that kind of thing"; "I mean there was a tremendous 
enthusiasm there wasn't there, they were really sort of getting in there" 

An example of direct positive comment on the teacher was: "I felt thai the lesson was 
very carefully crafted. " Less clear as a speech act. but also classified as positive 
comment on the teacher, was the comment: "it was quite interesting the way you were 
anticipating that they would have problems, you 'd he much more careful about how 
vou communicated " 

An area in which reassurance was sought in several discussions was that of learner 
involvement. Teachers said that they, often or on a particular occasion, were unsure 
if activities went on loo long or not long enough, if some students uere bored etc.. as 
they were unable to monitor all learners all the lime Observers replied positively in 
all cases - as far as they could see pacing and involvement were satisfactory, though 
in some cases it was agreed that differences in learner level etc. meant there was no 
ideal solution 

4.4.4 What attracts negative comments 

It is a general rule of human interaction that negative comments are made far more 
often about (especially absent) third parties, far less often about the speaker, least 
often about the addressee, so it is no surprise that most comments in the 'negative 
evaluation" category referred to students, e.g.: "A tends to wander off into his own 
little world quite a lot", "D can he quite aggressive"; 'There's one or two who don't 
like being corrected . . . seem to lose face a bit " 

It is striking however, that such comments usually refer lo one student, most of the 
rest to small sub-groups, very few to whole classes. The teachers generally seem to 
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have positive attitudes to their classes, and even the criticisms of indi\iduals mav 
usually be ; nterpreted as relating to the difficulty of doing certain kinds of work with 
them rather than as outright hostility. 

Self-criticism was only a minor feature of the discussions: although not infrequent it 
was typically brief, and in the nature of an aside: "My board work was pretty- awful. " 

Criticism of the teacher is infrequent and almost always mitigated or qualified. We 
do not suggest, however, that observers were withholding or excessively "toning 
down' negative comments for reasons of tact One can never know, but the evidence 
(see 4.2) and our impressions suggest that the teachers did feel generally positive 
about the lessons and about each other. But the difficulty of expressing even minor 
and constructive criticism needs to be borne in mind. 

4.4.5 What is perceived as surprising? 

Observers seemed to find the lessons interesting, but rareh surprising. II lis was 
perhaps to be expected as there is a culture of cooperation within General I nglish and 
a lot of informal discussion about what happens in classes For an exceptional 
'surprise', see 4.4.6.5. 

4.4.6 Specific issues of methodology and learner behaviour 

Under this heading, we consider methodological and similar issues which arose . 
some in only one discussion, some in most or all discussions 

4.4.6.1 Genuine communication versus practice of forms 

The first of these, the proper role for 'communication' activities and practice o< 
forms, and indeed how to distinguish between these, was addressed in some form ny 
most of the participants, most extensivelv when the COLT system had been used- 

" . what we're trying to achieve in the afternoon classes, we're trying to promote 
real communication but we have to give practice activities .. specially adiamed level 
thev're not like practising one particular function, it's usually some Kind of a 
strate^v . . so the fact that you give them a task m which xou w ant them to practise 
this but the task itself is not too constraining, is that genuine communication or not'*" 
(and later) 

"When xou were eliciting things from them, and although you didn't Know what their 
responses would be. is that genuine communication or not '" (OJ 

Learners in some classes had been given a range of exponents for expressing opinion, 
taking the floor and related functions, and when they practised these there was 
sometimes doubt about whether they had to express genuine opinions 'ft was ver\ 
interesting to tr\- to gauge at different points to what extern the\ were having a 
genuine discussion /or} just practising language very consctou\l\ and it seemed to 
slide very much backwards and forwards between the two " [O] 
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4.4.6.2 Error treatment 



This topic arose with similar frequency to the last, and at greater length. Space 
prohibits a full account of conclusions reached, but we quote from two discussions to 
give a flavour of the ideas expressed. " . a was quite interesting to know through the 
progression of the (esson whether it's certain activities that lend themselves to a 
certain kind of error correction, in which case it's quite important to plan one's 
lesson. " |()| 

In the following example, an observer reflects how different kinds of class at different 
times of da\ (see Section 2) require different attitudes to error: 7 expect it to be more 
teacher directed than student-centred which in fact happened and I also expected 
there to he more error t orrection, you know, than m a fluency class or something like 
that Error corrections and pronunciation checks and things like that so. mx 
preconceptions were justified so it wasn't surprising from that point of view, you 
know, given the kind of lesson it was " 

4.4.6.3 Teacher as model (articulation) 

This is an interesting example of a one-off comment which derives from an important 
issue on the observer's persona! agenda. No criticism seems to be implied, only 

wondering aloud", "it was quite interesting - and this is something I always worry- 
about. \ou were articulating very carefully when you were speaking to the students I 
do that . I just wonder are some teachers doing it. you know as a sort of. saying it 
in a \en fluent natne speaker way and not articulating? \0\ 

4.4.6.4 Dominance in group work 

The observer in one discussion chose to investigate whether particular learners were 
dominant in group work whilst others said little, this is of course a common area of 
both system based and open-ended observation, promoted especially b\ All w right. 
The conclusion was that in this case no-one was obviously dominant, and no-one 
excluded, but an interesting pattern was noted "It was A and B who were doing most 
of the talking, and then the blonde woman, well her role seemed quite interesting 
she seemed to be slightly also taking on the teacher s role in that she sometimes, I 
think she once or (Mice corrected people or provided words that \omebod\ else was 
hooking for. thes seemed to look to her as a sort of linguistic consultant " 

4.4.6.5 Learner independence 

One discussion was different from the others in that, in the observed lesson, the 
teacher had adopted a range of procedures which both teacher and observer perceived 
as somewhat unusual or individualistic, and which had an explicit rationale of 
encouraging learner independence Thus, for example, the class had watched TV 
programmes, chosen by themselves, aided b\ their own lists of predictions 'questions 
rather than teacher-devised worksheets, m order to show them a wav to benefit from 
watching normal TV at home: and many questions about vocabulary, even requests 
tor guidance on the best way to learn', were turned back for the students to answer 
themselves In the discussion, the observer generally praised this approach (7 lo\e 
the way sou did that"), but also voiced doubts, e g "I'm just wondering what happens 




if nobody knows". The teacher elaborated the thinking behind the approach, but 
modestly disclaimed any definitive answers and accepted that die approach would not 
always work, even giving an example of a 'failure* after the observer had left the 
lesson. 

As mentioned above (4.4.5), not much in the observed lessons appeared to be 
perceived as surprising, and this discussion seems to be the only case within the 
discussions of something being described as radically new. 

Other teachers too were very conscious of the learner independence issue, and 
provided examples in their actions as teachers or their suggestions as observers. One 
teacher, for in stance, had invited a student to explain something to another student, 
and justified mis as follows: "Well J like to do that because, rather than me just 
savins It mean*, this', which in that state I'm becoming the dictionary and I'm trying 
to wean them off ii:ese wretched dictionaries so it's better if they're trying to ... " 

The next example shows the same desire for learner independence, but a itss 
satisfactory reality: "what's really unfortunate is even if they are in groups, they'll 
still kind of try and turn round and involve me and sort of call me in you know. " * 

Finally, the 'learner independence" area provides one of the few examples in the post- 
lesson discussions of a detailed suggestion from an observer: 7 noticed that when 
he'd maybe finished he just sort of tended to. he'd obviously, what was his name. A 
had obviously finished and you think well, he could have been encouraged more to 
help, or maybe, I don't know, maybe he didn't like helping his friend, you know, and 
so he maybe, getting him to explain Why did you put this?'. Why did you put that?'" 

4.4.7 Feelings about doing observation 

The general idea of observing each other's lessons seemed to be viewed very 
positively. As regards the use of wematic coding s\ stems, or am kind of 
systematic peer observation, comments were more cautious - still positive, but aware 
of the difficulties and the need for more experience Sample comments 7 suppose 
it's sen significant that when teachers sit down to talk about a class, the mode that 
you tend to slip into is evaluative, even if it's wr\ encouragingly, because most often 
any time you're actually paid to sit down and talk about someone else's class it's 
because you're examining them or you're helping them towards ar exam, or you're 
seeing how it should be done from somebody who has more experience " |TJ; "you're 
switching into obsen er mode for a particular thing and you 're not aware of of all the 
other things that are going - you 're looking for X and there's A to Z going on around 
you because you're looking for X" |0]; 7 think as practising chalkface teachers 
we're very interested in how things work and classroom management techniques and 
skills and so on ... it's relevant to this obsetration thing that we're doing that you 
tend to gel caught up with those pedagogical issues " \0\ 

5. Disrussinn And Conclusions 

5.1 Discussion of Transcript Codings: 'Topic* Dimension 
The following general features may be noted 
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(i) In all discussions for both speakers ihe observed lesson (category 5, including 
5.1 and 5.2) is, not surprisingly, ihe main topic. 

(ii) Within this category the emphasis varies, some discussions emphasising learner 
behaviour, some teacher behaviour, some more evenly balanced. On the whole, 
however, learners were discussed more than teachers. This may reflect both the 
current climate of opinion within EFL and the perceived usefulness of another 
perspective on learner interaction. 

(iii) The second most consistently frequent category - more than 10 codings in each 
of six discussions - was category 6 (including 6.1 and 6.2). i.e. what the 
observed teacher did in other lessons, including parts of the observed lesson 
before and after observation. The fell need to put observed events in context is 
unsurprising. 

(iv) The only other categories which even approached this frequency - each having 
more than 10 codings in each of four discussions - were category 8 (including 
8.1 and 8.2). i.e. lessons in general, and category 2. the coding system. 

(v) Onlv three other categories ever exceeded the '10 codings' threshold, and these 
onl> in one discussion each, reflecting a particular focus of that discussion. 
These were. The leaching material (category 10); Feelings about being 
observed (categon 1 1.2); The English language (category 12) 

ivi) There was a tendency for similar topics to be discussed in each of a pair of 
discussions with the same participants. 

At this point it may he worth repealing thai the eihos of the project was non- 
evaluative, and we shall not presume to suggest that high or low use of any topic is 
good' or 'bad*. The teachers discussed what they identified as worth discussing, 
exactly as intended. If one were planning a more extensive and structured peer 
observation studv. however, one might wish to look for ways, over a long series of 
discussions, of ensuring a wide and systematic topic coverage including both teacher 
and learner behaviour. 

5 2 Discussion of Transcrip t flings - 'Sp^n Act' Dimension 

The first point to note here is a blurring of the role distinction which might have been 
expected: for example, not only the observer but also the teacher sometimes evaluates 
what happened in a lesson, and not onl> the teacher but also the observer justifies it 
This perhaps indicates a high level of mutual supportiveness with the group, with 
strong desire to convey feelings of solidarity and emphasize the shared features ot 
experience 

Beyond this, we were struck by the wide variation of speech act frequency in the 
discussions tlv; differences between the discussions are far more salient than the 
similarities. For example, two discussions, with their high frequency on the part of 
the observer, of questioning and 'adverting or semi-phaiic' (i.e. mentioning something 
known to both speakers), seem to be a very different kind of speech event from other 
discussions, where these categories are much rarer. (Other untypical figures, such as 
the high 'back-channelling' rate of one observer, may reflect individual speech 
stvles.) 
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What is common to all discussions, however, is a fairly high rate of evaluating' acts 
by the observer (sometimes, only late in the discussion and after f; quent invitations 
to evaluate by the teacher.) Most of these comments were on the observed lesson, 
although other topics (materials, students, other lessons) were sometimes evaluated. 
All teachers made one or more evaluative comments on their own lessons, though 
sometimes not many and always fewer than the observer. Evaluations were in general 
positive, and any negative comments were tentative and qualified. 

The frequency of evaluative comments seems to confirm that peer observation is 
always likely to be a partially evaluative process, and Out. although one can mitigate 
this by emphasizing non-judgmental aspects, one cannot, and perhaps should not want 
to. eliminate it entirely. 

5.3 General Conclusions 

Our first, and unsurprising, conclusion is that ihe peer observation was worth doing. 
Teachers did appreciate the opportunity, surprisingly rare in most prolessional lives, 
to observe another teacher's lesson and to he observed without any context ol 
evaluation or bureaucratic requirement. 

Second, and less certain a priori, the coding systems seemed to be of some value. 
Every professional in the area of systematic observation knows that all existing 
systems are far from ideal, sometimes difficult to apply - especially to classes taught 
by modern methods - and not always yielding insights, and the observer comments 
(see especially 4.4.1) amply confirmed this. Nonetheless, observers did persevere 
with systems, often filling in codinr sheets \ery fully - perhaps more fully than we 
had expected - and showing great re ourcefulness in taking the systems as a s'. -liny 
point for more open-ended comments on topics of major interest 

Our third conclusion relates to the low inter coder reliability on our speech-act' 
dimension. It seems either that we are unusually incompetent m recognising 
illocutionary force, or. more probably, that what is said in discussions of this type is 
even more polysemic (polypragmatic'.M man one would generally suppose. This could 
be a fruitful area for further research. 

Fourthly, despite these uncertainties of pragmatic detail, the general goodwill, 
enthusiasm, mutual supportiveness and professional commitment of the teachers was 
very much in evidence, as was the structured and principled nature of the curriculum 
which they were implementing. 

Fifthly, it seems that further peer observation, although not an uigent priority, would 
be of potential benefit to the course, to those of the eight teachers still working on it 
and to others who have replaced some of them As usual in such research. an> 
second round of observation could profitably be made slightl> more selective and 
structured, building on the findings of this pilot study. Posilesson discussion could 
be similarly guided, with a wide and systematic topic coverage including both teacher 
and learner behaviour. 
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